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This  is  the  final  report  on  a  1  year  study  of  convergence  rate  in 
adaptive  arrays,  performed  under  a  contract  from  the  Naval  Air  Systems 
Command.  The  results  obtained  earlier  in  the  study  are  reported  in 
three  quarterly  progress  reports.  This  introductory  section  of  the 
final  report  reviews  the  earlier  results  briefly.  The  remainder  of 
this  report  details  the  results  obtained  during  the  fourth  quarter  of 
the  study. 

In  many  cases  of  interest,  slow  convergence  limits  the  performance 
of  adaptive  array  antennas.  The  steady  state  performance  and  transient 
response  of  an  adaptive  array  are  determined  by  the  covariance  matrix 
of  the  noise  field.  While  the  transient  response  is  also  a  function 
of  the  parameters  of  the  adaptive  loops  in  an  analog  system,  it  is  known 
that  convergence  is  slow  when  the  eigenvalues  of  the  noise  covariance 
matrix  are  widely  different  in  value.  In  these  cases,  no  choice  of 
adaptive  loop  parameters  can  provide  fast  transient  response  and  low 
control  loop  noise. ^ 

In  a  digital  adaptive  array,  where  the  individual  element  outputs 
are  A/D  converted  and  the  adaptive  weights  are  computed  using  a  sample 
covariance  matrix,  rapid  convergence  can  be  obtained  independently  of 
the  distribution  of  the  eigenvalues.^ 

When  the  outputs  of  the  different  elements  in  an  adaptive  array  are 
mutually  independent.  It  is  easy  to  achieve  rapid  convergence  in  an 
analog  system.  One  method  of  transforming  the  array  element  outputs  to 
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a  set  of  independent  variables  is  based  on  a  transformation  to  normal 
[31 

coordinates.  J  A  simpler  transformation  to  implement  is  based  on  the 
Gram-Schmidt  orthogonal ization.  The  application  of  a  Gram-Schmidt 
network  to  adaptive  arrays  was  suggested  independently  by  at  least  three 
different  groups  working  in  the  field,  including  TSC.  Our  interest  in 
this  subject  was  preceded  by  work  by  Girandau^  and  others. 

A  self-orthogonal izing  network  which  transforms  the  set  of  array 
element  outputs  to  a  set  of  independent  variables  (Z^>  is  illustrated 

in  Fig.  1.  The  outputs  can  be  equalized  in  power  using  automatic  gain 
control  (ACG)  and  followed  by  any  desired  type  of  adaptive  array,  including 
the  pilot  signal  and  power  inversion  arrays  of  primary  interest  in  communi¬ 
cations.  It  was  shown  in  the  first  quarterly  progress  report  that  the 
outputs  Zk  are  independent.  The  network  of  Fig.  1  is  a  power  inversion 
array,  the  desired  output  being  Z^. 

Each  node  in  the  network  has  two  inputs,  Xkk  and  Xkn,  and  generates 
an  adaptively  controlled  weight  Wkn<  The  output  of  a  node  is 

W  xkn  -  "i™  xkk  o 

The  weights  approach  steady  state  values  of 
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Figure  1.  Adaptive  Self-Orthogonallzlng  Network  Based 
on  Gram- Schmidt 
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Analog  circuits  for  generating  the  adaptive  weights  are  illustrated 
in  Fig.  2. 

Simulation  results  are  shown  in  Figs.  3  and  4  which  illustrate  the 
large  improvement  in  convergence  rate  achievable  with  the  self-ortho- 
gonalizing  networks.  The  same  3  element  array  and  2  unequal  interference 
sources  were  simulated  in  both  cases.  A  conventional  3  element  power 
inversion  array  with  2  adaptive  weights  was  used  in  the  simulation  of 
Fig.  3.  Much  faster  convergence  was  obtained  with  the  self-orthogonalizing 
network  of  3  adaptive  weights  as  shown  in  Fig.  4.  Examples  showing  very 
rapid  convergence  with  the  Gram- Schmidt  network  -  convergence  in  N  samples 
with  an  N+l  element  array  -  are  also  contained  in  the  first  quarterly 
report.  The  theory  of  these  rapidly  converging  systems,  relating  the 
sample  covariance  matrix  and  Gram-Schmidt  solutions,  is  discussed  in  the 
first  report. 

The  second  and  third  quarterly  reports,  and  the  remainder  of  this 
report,  deal  with  control  loop  (weight  jitter)  noise  in  the  self-ortho¬ 
gonalizing  networks.  The  second  quarterly  report  applies  Tikhonov’s 
method  to  the  problem  and  contains  some  approximate  solutions  for  the 
first  and  second  moments  of  the  weights  in  these  networks.  A  solution 
for  the  3  element  array,  a  self-orthogonalizing  network  containing  3 
weights,  based  on  a  first  order  perturbation  theory,  is  contained  in 
the  third  quarterly  report.  The  third  report  also  discusses  the  dif¬ 
ferential  equations  describing  the  transient  response  of  a  3  element 
network. 


Figure  2.  Analog  Adaptive  Control  Circuits 
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The  next  section  of  this  report  presents  a  simple  derivation  of  the 
second  moments  of  weight  jitter  in  a  self-orthogonal izing  network.  This 
result  also  provides  a  simple  method  of  analyzing  control  loop  noise  in 
a  conventional  N-loop,  N-element  adaptive  array.  A  general  expression  for 
control  loop  noise  in  a  Gram-Schmidt  network  of  arbitrary  size  is  derived 
by  induction  in  Section  3  below. 
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2.0  SECOND  MOMENTS  OF  WEIGHT  JITTER 


An  expression  for  the  second  moments  of  the  weight  fluctuations  is 
required  in  order  to  compute  the  control  loop  noise  component  in  the 
output  of  a  Gram-Schmidt  network.  Only  the  second  moments  for  weights 
in  the  same  row  of  the  network  (Fig.  1)  are  required.  Consider  the  net¬ 
work  of  Fig.  2,  containing  two  weights  W^  and  W^.  The  weights  satisfy 
the  equation 


Gkn  W|cn  +  X|(k  Xkk  W|cn  =  Xkk  Xkn 


(3) 


★ 

If  a  leaky  integrator  is  used,  the  Xkk  Xfck  term  is  replaced  with 

(<k  Xkk  +  jsr— )•  To  achieve  near  optimum  weights  in  the  steady  state 
kn  * 

condition,  the  1 /Gkn  term  must  be  small  compared  to  Xkk  Xkk  and  can  be 

neglected. 

To  obtain  a  perturbation  equation  for  the  weight  jitter,  let 

W.  =  W.  +  6.  ,  where  W.  is  the  mean  value  of  W.  .  Let  cr  denote 
kn  kn  kn’  kn  kn  mn 

Xkm  Xkn*  Then 


4  Wkn  +  akk  ffkn  =  akn 


(4) 


Subtracting  (4)  from  (3), 


~  *kn  +  Xkk  Xkk  6kn  =  Xkk(Xkn  "  ffkn  XkkJ  +  (akk  Wkn  “ 


’kn 


We  will  consider  the  weight  fluctuations  after  the  mean  weights  have  reached 

steady  state  values,  i.e.,  Wkn  =  okn/okk  and  the  last  term  of  (5)  is  zero. 

In  most  cases  of  interest,  there  is  sufficient  smoothing  in  the  control 

loop  so  that  the  weights  fluctuate  slowly  compared  to  variations  in  the 

★ 

Xkn.  The  fluctuation  $kn  is  then  independent  of  the  instantaneous  Xkk  Xkk 
and  their  product  in  (5)  is  replaced  with  akk  6n-  Then  (5)  reduces  to 

4n  +  0kk  5kn  =  Xkk*Xkn  “  ^kn  V  =  Xkk  Un 

Note  that  the  right  side  of  (6)  is  Xkk  times  (Xk+1  n  +5kn  Xkk),  i.e.,  Un 
is  the  output  Xk+^  n  less  the  component  of  Xk+1  n  due  to  the  fluctuation 


In  (6),  the  weight  fluctuation  $.  is  smoothed  by  a  low  pass  filter 


with  impulse  response 


1  _t/Tn 


where  the  effective  time  constant  t  =  g — - —  .  The  output  of  this  filter 

n  kn  kk 


W1' 


00 

-  f  hn< 


(t)  Xkk(t-T)Un(t-T)dT 


The  second  moment  is 


fikm  5kn 


00 

’fh 


(t)  hm(a)  Xkk(t-T)Xkk(t-a)Un(t-T)U*(t-a)  dr  do 


n 


Since  is  independent  of  both  Un  and  Um> 


* 

a ,  c. 
km  kn 


GO  °0 

/  /hn(T)  hn,(o,)  Rkk 


(x-a) 


mn 


(a-r)  dt  da 


(10) 


where: 


Rkk^  "  Xkk^  Xkk^t4u^ 

Rkk(0j  =  akk 

^(u)  -  U*(t)  Un(t+u) 


As  noted  earlier,  we  consider  the  usual  case  where  the  bandwidth  of 

an  adaptive  loop  is  small  compared  to  the  bandwidth  of  the  input  Xkk  and 

Xkn»  In  (6),  the  bandwidth  of  the  low  pass  filter  represented  by  the 

left  side  of  the  equation  is  small  compared  to  the  bandwidth  of  the 

* 

noise  driving  function  Xkk  Un  on  the  right  side.  Thus,  the  impulse 
response  functions  1^(T)  are  very  long  in  duration  relative  to  the  width 
of  the  correlation  functions  R^  and  Rmn.  The  expression  (10)  for  the 
second  moment  can  be  rewritten  in  the  form 

oo  t 

SL  \n  ■/  h„<T>dT/  hm<T-u>Rkk(u)  Rnrn(-u,du  (U) 

o 


<VTn,T 


1 


2 

lmlnakk 


/  e"  Vn  <hf 


-Z/t, 


Rkk(-u)Rmn(u)e  "  dz 


“(vO 


'kk 


(0)^(0) 


'kk 
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In  evaluating  the  integral  with  respect  to  z,  the  exponential  term 
e-Z//tn  is  approximately  unity  over  the  z  interval  where  the  and 
Rmn  terms  are  non-zero.  In  effect,  A  is  the  time  interval  between 
independent  samples  of  the  Un  driving  function  in  (6).  More  precisely 


A  = 


CO 

L 


v- 


2) 


Wz> 


dz 


02) 


The  resulting  equation  for  the  second  moment  of  the  weight  fluctuations 


is 


(13) 


In  many  applications  of  adaptive  arrays,  the  input  power  levels  can  vary 
over  a  wide  range.  It  is  desirable  to  include  some  form  of  AGC  in  these 
cases  to  prevent  wide  variations  in  effective  loop  time  constants,  which 
result  in  variations  in  control  loop  noise  and  convergence  rate.  One 
method  of  achieving  gain  control  is  illustrated  in  Fig.  2.  The  can 
be  decreased  when  the  input  power  increases.  Let 


Then  the  equation  for  the  second  moments,  (13),  reduces  to 

Skm  Skn  57  °kk 


-  G  m  n 

?wm  okk 


(14) 


(15) 
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3.0  EXCESS  OUTPUT  NOISE  DUE  TO  WEIGHT  JITTER 


Consider  the  Gram-Schmidt  network  of  Fig.  1.  Each  node  in  the  network 
consists  of  an  adaptive  control  loop  as  illustrated  in  Fig.  2.  The 
variables  Xj,n  in  Fig.  1  denote  the  noise  at  various  points  in  the  network 
when  all  weights  have  their  mean  steady  state  values.  The  weights  are 
again  represented  as  the  sum  of  mean  values  Wkn  and  small  fluctuating 
components  S^.  In  terms  of  these  variables,  the  network  is  described  by 
the  following  equations 


Wkn  =  Wkn  +  5kn 


tr  -  Xkk  Xkn 
wkn  "  - *- 


Xk+1 ,n  =  Xkn  ”  Wkn  Xkk 


We  define  a  set  of  Y^n>  additive  to  the  set  of  X^  at  the  respective 
points  in  the  network,  as  the  additional  noise  components  due  to  weight 
jitter  earlier  in  the  network  (see  Fig.  5).  It  is  assumed  that  the  Y^ 
are  small  compared  to  the  X..  The  Y.  satisfy  the  equations 


Vl.n  '  Ykn  *  ffkn  Vkk  *  skn  xkk 


Yl„-° 


4, 
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Note  that  the  second  order  term  5^  is  assumed  small  relative  to  Y^n 
and  WRn  Y^k,  and  has  been  neglected.  The  theory  developed  here  is  a  first 
order  perturbation  analysis,  based  on  small  <5kn  and  Y^n.  The  effect  of 
weight  jitter  earlier  in  the  network  is  neglected  in  computing  the  weight 
jitter  at  a  given  node. 

We  consider  the  case  where  the  effective  time  constants  are  the  same 
for  all  adaptive  loops  in  the  network.  It  is  further  assumed  that  the  X^k 
are  all  normalized  to  unit  power  as  shown  in  Fig.  5  to  achieve  the  AGC. 

Let  all  Gkn  =  G,  !xkk  I2  =  1  for  all  k,  and  =  T/A>  the  time  constant 
measured  in  sample  intervals  of  the  input  noise.  From  (15),  the  second 
moments  of  the  weight  fluctuations  are  then 


6  6=  —2 _  y  y 

km  km  2T^  *k+l  ,m  Ak+1  ,n 


since  the  Xkn  as  defined  here  are  equal  to  the  Un  of  (15). 

The  following  expression  for  the  second  moments  of  the  Ykn  will  be 
proved  by  induction 


Ykm  Ykn  =  2^  Xkm  Xkn 


Assume  that  (21)  is  true  for  row  k  of  the  sel f -orthogonal i zing  network. 
Then  for  row  k+1 , 


Yk+l,m  Yk+1 ,n  *  ^Ykm  "  Wkm  YkkJ  (Ykn  *  Wkn  V  +  6km  6kn  lXkkl< 
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This  equation  is  obtained  from  (19)  and  the  observation  that  the  instan¬ 
taneous  Yj,n  are  independent  of  the  6^.  Substituting  (21)  and  (20)  into 
(22)  gives 


Y*  Y  =  (fc~^ )G  (v*  v  -  W*  X*  X  -  W  X*  X 
Vl.m  Yk+l,n  2t ■,  'Akm  *kn  wkm  *kk  Akn  wkn  *km  *kk 


+  Wkm  Wkm  'XkJ2)  +  2?1  Xk+1  ,m  Xk+1  ,n 


(23) 


Substituting  (18)  into  (23),  it  reduces  to 


Y*  y  =  x*  X 

Tk+l,m  Yk+l,n  2t]  Vl  ,m  Vl  ,n 


(24) 


This  proves  that  if  (21)  is  true  for  row  k  of  a  Gram- Schmidt  network,  it 
is  also  true  for  row  (k+1).  Note  that  this  equation  remains  valid  after 
AGO.  It  remains  to  be  shown  that  (21)  is  true  for  one  row.  It  is 
clearly  satisfied  for  the  first  row.  However,  the  k=l  row  is  a  special 
case,  since  there  is  no  weight  jitter  noise  on  the  array  inputs,  Xln. 

For  row  2,  the  weight  jitter  noise  is  due  entirely  to  fluctuations  in 
the  WlfJ.  From  (20), 


6lm  6ln 


2^  X2m  X2n 


(25) 


and  the  corresponding  second  moments  of  the  Ygn  are 


Y2n  * 


6lm  6ln 


(26) 


since  |X^|£  is  unity.  Thus  (21)  is  satisfied  for  row  2  and  throughout 
the  remainder  of  the  network.  This  completes  the  proof  of  (21).  The 
assumptions  in  the  proof  are  normalization  of  all  to  unit  power,  and 
equality  of  the  G  and  x  parameters  at  all  nodes. 

The  control  loop  noise  component  at  the  output  of  the  network  in 
Fig.  1  is  then 

iv  |2  =  |x  |2  (27) 

|YNNl  2t1  |ANN' 

This  result  applies  for  Gram-Schmidt  networks  of  any  size. 


19 


4.0  FULL  FEEDBACK  IN  SELF-ORTHOGONALIZING  NETWORKS 


It  is  interesting  to  consider  what  happens  in  the  Gram-Schmidt  network 

of  Fig.  1  when  the  adaptive  loop  at  one  node  fails.  Assume,  for  example, 

__ 

that  the  loop  generating  W^2  in  Fig.  1  fails  and  W^2  =  0.  If  X^2  f  0, 
this  is  not  the  correct  weight.  In  this  case,  X^  and  X22  are  not  indepen¬ 
dent,  and  X22  equals  X^2.  The  network  consisting  of  the  first  3  columns, 
generating  the  output  Z3,  would  not  successfully  null  two  interference 
sources.  This  can  be  shown  as  follows. 

The  output  of  the  third  column,  Z^»  has  a  mean  square  value  of 


|z3|  =  |x13  -  w13  x^  -  w23  x22|‘ 


This  output  power  is  minimized  for  optimum  weights  Wj3  and  W23  which 


satisfy  the  equation 


W13  lXlll  +  W23  X11  X22  =  X11  X13 


W13  X22  X11  +  W23  I X22^  =  X22  X13 


The  weights  generated  by  the  network  of  Fig.  1  are 


"13  * 


W23  * 


X11  X13 


X22  X23  X22  X13  (X11  X13^X22  X11^ 


lX22l' 


lxlll  lX22^ 


Z\ 


These  steady  state  weights  are  optimum  when  X^  Xg£  =  0,  i.e.,  when  the 


correct  weight  is  generated  at  the  node.  Otherwise,  when  X^  X^  i  0 
the  three  element  network  does  not  develop  an  optimum  steady  state  solution 
An  alternative  method  of  implementing  a  self-orthogonal izing  array 


is  illustrated  in  Fig.  6.  The  output  of  a  column,  Zn,  is  fed  back  as 


one  input  to  each  node  in  the  column.  The  inputs  to  the  correlator 
generating  the  weight  Wfcn  are  Xnn  and  Xkk-  By  comparison  with  the  net¬ 
work  of  Fig.  1,  the  Xfc+1  n  input  to  the  W((n  correlator  is  replaced  with 


Xnn*  the  column  outPut*  modified  network  will  also  develop  a  set 


of  independent  outputs  Zn-  Furthermore,  the  use  of  this  full  feedback 


on  the  nth  column  of  the  array  assures  that  the  output  ZR  is  independent 


of  all  X^  for  k<n  in  the  steady  state  condition. 


For  example,  consider  the  output  Z3  in  Fig.  6.  When  a  weight  has 
reached  its  steady  state  value,  the  two  inputs  to  the  correlator  generating 
that  weight  are  uncorrelated.  Thus  the  correct  steady  state  value  for 
satisfies  the  equation 


X11  X22  =  X11(X12  '  W12  Xll}  =  0  (31) 

Suppose  W.J2  *  0,  a  failure  at  the  first  node.  The  steady  state  weights 
ff13  and  ¥23  then  satisfy  the  equation 

X11(X13  "  ff13  X11  "  ff23  X12*  “  0 

(32) 


Woo  X-lo)  *  0 


Figure  6.  Self-Orthogonallzlng  Network 
with  Full  Feedback 
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These  weights  do  satisfy  (29),  and  thus  are  the  optimum  weights  for  the 
network  when  =  0.  The  output  Zg  is  the  same  with  the  network  of 
Fig.  6,  independent  of  W^- 

More  generally,  when  the  weight  W^n  is  in  error  due  to  failure  at 
the  kn  node,  the  steady  state  outputs  Z  ^  ,Zn+p,...  ,Z^  will  be  correct 
(i.e.,  independent  of  Z^  for  k<n+l)  in  the  network  of  Fig.  6.  These 
later  outputs  would  be  wrong  due  to  the  W^n  error  in  the  network  of  Fig.  1. 

The  weight  jitter  is  also  smaller  at  most  nodes  with  the  full  feed¬ 
back  network  of  Fig.  6.  In  computing  the  second  moments  of  weight 
fluctuations  with  full  feedback,  the  two  inputs  to  a  correlator  generating 
V*kn  are  Xkk  and  ^n*  The  cluant‘ity  un  (6)  is  replaced  with  Zn.  The 
derivation  follows  closely  that  of  Section  2.0,  with  a  final  result 


6km  5kn 


G  ^m  ^n 
2t1  akk 


(33) 


2 

in  place  of  (20).  In  the  near  steady  state  condition  JZJ  is  less  than 
lXk+l  J  f°r  k+^<n»  so  t*ie  mean  s1uar6  weight  jitter  is  also  smaller  for 
a  given  G/x1  ratio. 

However,  this  does  not  imply  that  the  control  loop  noise  component 
Is  smaller  In  the  output  of  a  full  feedback  network  (Fig.  6)  than  in  the 
Gram-Schmidt  network  (Fig.  1)  for  a  given  G/t^  at  all  nodes.  The  cross 
moments  of  the  weight  fluctuations  also  affect  this  control  loop  noise 
component.  With  full  feedback,  all  weight  fluctuations  are  mutually 
Independent  (i.e.,  5km<5ln  *  0  unless  k=t  and  m=n).  For  different  nodes 
in  a  column,  the  Xkk  are  independent  and  Rkk  ■  0  in  (10).  For  different 
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nodes  in  a  row,  the  Zn  are  independent  and  Rmn  =  0  in  (10).  At  least  in 

the  first  order  perturbation  theory  of  control  loop  noise  of  Section  2.0, 

all  weight  fluctuations  are  independent. 

All  nodes  in  the  network  which  precede  a  given  output  contribute  to 

the  control  loop  noise  component  in  that  output.  The  control  loop  noise 

in  Zn  includes  (n-1)  components  due  to  weight  jitter  in  the  nth  column, 

each  of  mean  square  value  G/2t^.  This  again  assumes  that  the  are 

normalized  to  unit  power.  These  components  from  the  nth  column  add  up 

to  |Z  |  .  Additional  noise  is  contributed  by  all  nodes  in  the 

1 

network  of  Fig.  6  for  which  k<n.  Thus,  the  total  control  loop  noise  in 
the  output  Zn  exceeds  the  weight  jitter  noise  for  the  corresponding  Gram- 
Schmidt  network  (Fig.  1),  which  is  given  by  (27)  and  equals  the  noise 
component  from  the  nth  column  (Fig.  6)  alone. 

For  example,  with  the  full  feedback  network  and  al  1  Xkk  normalized 
to  unit  power,  the  control  loop  noise  component  in  Z^  is 


l Y33^  =  2t-|  ^Z3l  +  1^23^ 


(34) 


The  corresponding  control  loop  noise  for  the  Gram-Schmidt  network  is 

I Y33^2  =  FFj"  2|Z3!2  (35> 

and  1$  less. 

In  choosing  between  the  two  alternative  methods  of  feedback,  transient 
response  of  the  weights  must  also  be  considered.  With  full  feedback, 
the  transient  response  of  the  weights  in  row  n  depends  on  the  covariance 
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5.0  CONCLUSIONS 

A  generalized  expression  has  been  derived  for  the  weight  jitter 
noise  in  the  output  of  a  Gram-Schmidt  self  orthogonal izing  network  of 
any  dimensionality  (£q.  27).  In  earlier  quarterly  reports  on  this  con¬ 
tract,  it  was  shown  that  these  networks  transform  the  inputs  to  a  set 
of  independent  variables,  the  networks  can  be  utilized  readily  in 
either  pilot  signal  or  power  inversion  arrays  for  communications,  and 
that  this  transformation  provides  fast  convergence  in  cases  of  disparate 
eigenvalues  where  the  more  conventional  circuits  converge  slowly. 

An  alternative  method  of  implementing  a  self-orthogonal izing  array, 
using  full  feedback  along  each  column  (Section  4  above),  is  more  tolerant 
to  failures  at  nodes  in  the  network,  but  generates  more  weight  jitter 
noise  in  the  output  for  a  given  convergence  rate. 
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